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The present invention relates to telem icroscopy and 
microscopy training. 
5 Telemedicine, by which a range of data, such as x-rays 

or ECG traces, relating to a patient is transmitted from 
one location to another for diagnosis or a second opinion, 
is the focus of much attention because of its potential to 
improve the quality of healthcare while reducing costs. 
10 There have been many attempts at developing telemedical 
applications involving the use of microscopes , such as 
telepathology and telecytology . All involve the capture of 
digital or analogue images from a microscope and 
Q transmission of these images to a remote site for the 

15 purpose of a second opinion or remote diagnosis. However, 
j}i as will be described, none of the existing systems has been 

W entirely satisfactory. 

^ A fundamental problem in the field of telemicroscopy 

fjy is that the field of view of the microscope is tiny in 

20 relation to the size of the specimen on the microscope 
£ slide. By way of example, a typical cytology 'smear' will 

rU occupy an area of at least 20mm by 50mm, that is 1000mm 2 . 

S The field of view of a typical 20x magnification objective 

O lens is only about 0.4mm by 0.4mm, or 0.16mm 2 . The entire 

25 image can therefore be considered to be formed by over 6000 
distinct fields. A remote consultant will not want to make 
a diagnosis on the basis of just a few images selected by 
another worker, he will want to have access to the whole of 
the slide and to be able to change or have changed the 
30 magnification as and where he wishes. 

The simplest solution to this problem is a procedure j 
known as static tele-microscopy. In its very basic form, 
all that is required is a camera coupled to the microscope, 
some basic software, a network connection such as via the 
35 Internet to a remote display, and means for voice 
communication between the two locations. The microscope is 
operated by a local worker who will typically, based on 
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their own knowledge, select an initial area for review by 
the remote consultant. An image of that area will be 
acquired and transmitted to the remote consultant's 
monitor. Based upon what he can see, he relays instructions 
5 over the telephone to the local worker - left, right,, up, 
down, increase magnification, etc. Further images are 
acquired and relayed to the consultant until he is 
satisfied that he has sufficient information upon which to 
base his diagnosis. Such static telepathology systems have 
10 the virtue of simplicity and low cost. However, trials have 
repeatedly confirmed that it is unsatisfactory in practice 
to rely upon a few fixed images and few consultants will be 
prepared to offer an opinion or make a diagnosis on this 
basis . 

15 An improved system is known as dynamic telemicroscopy . 

Essentially, once the slide has been prepared locally, the 
microscope itself is operated remotely by the remote 
consultant. Examples are shown in US-A-5 216 596 and 
US-A-5 297 034. An example has also been placed on public 

2 0 access via the Internet by the Department of Pathology at 
the Charite Hospital in Berlin 

(http: // amba.charite.de/telemic/ index. html . ) . However, 
such on-line systems are expensive both in terms of buying 
the equipment and in terms of the consultant's time. These 

25 systems also need high bandwidth telecommunications, 
typically at least 384 kbits/sec for even only moderately 
satisfactory use. Whilst the consultant has full control 
over the microscope, there are delays whilst instructions 
are relayed to the microscope, the microscope is adjusted 

30 in accordance with those instructions, and the new image is 
obtained and relayed to the consultant. Such systems cannot 
strictly be considered to operate in real-time. For a 
comparison, whilst a consultant operating a local 
microscope could perhaps examine a sample and provide a 

35 diagnosis in a straightforward case in around a minute or 
perhaps 3 or 4 minutes for a more involved diagnosis, 
whereas even with dynamic telemicroscopy and experienced 



3 


operators each examination can take in the order of ten 
minutes or so. 

There is therefore a need for an improved method of 
telemicroscopy . 

5 The invention also relates to the area of microscopy 

training, and particularly to the area of teaching of 
diagnostic methods employing microscopy. 

At present training in diagnostic microscopy performed 
either by circulating prepared sections on glass slides 

10 formed by the circulation of electric microscopy images of 
a data storage medium such as CD ROM. The former of these 
two approaches is time consuming and inconvenient, 
particularly because samples get misplaced or damaged in 
transit. Both methods have the further disadvantage that 

15 there is both specific monitoring of whether or not a 
student performs a diagnosis simply by chance or by 
incorrect methods, meaning that both are limited teaching 
tools. 

In the context of telemicroscopy and indeed any form 

2 0 of microscopy where images are displayed on a monitor 
rather than viewed directly by the eye, it is perhaps 
misleading to talk in terms of magnification. If an image 
is obtained and displayed full screen on a 17 inch computer 
monitor, the magnification will be greater than if the same 

25 image is displayed full screen on a 15 inch monitor. The 
resolution will, however, be the same. Accordingly, the 
term resolution is a better descriptor of the amount of 
information given in a particular image and relates, in the 
context of a digital camera, to the number of pixels of the 

30 CCD device per unit area of field of view. 

According to the present invention, there is provided, 
in one aspect, a method of telemicroscopy comprising the 
steps of: preparing a specimen on a microscopy slide; 
placing the slide upon the stage of a microscope equipped 

35 with digital imaging apparatus and motor ised stage; imaging 
the specimen to obtain a composite high resolution image of 
the whole specimen; digitally obtaining a relatively low 
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resolution copy of that image; and storing the images in a 
datastore; wherein the method further comprises the steps 
of allowing access to the datastore from a terminal; 
transferring the low resolution image to the terminal and 
5 displaying the image upon a monitor; selecting by means of 
the remote terminal, as desired, an area of the low 
resolution image and transferring corresponding high 
resolution image data for that area from the datastore to 
the terminal. 

10 The terminal may be a remote terminal. 

The method may comprise the step of recording the 
areas of the low resolution image that are selected, for 
review of performance of a person performing the method. 

In a second aspect, the present invention provides a 

15 telemicroscopy apparatus comprising a microscope provided 
with a digital imaging apparatus and a motorised stage 
which can be controlled to obtain a digital image or 
plurality of such images, at a desired high resolution, of 
an entire specimen placed upon the stage; image processing 

2 0 means to obtain a low resolution copy of the image of the 
specimen; storage means to store the images obtained; and 
means for transferring, in use, image data to a terminal in 
response to requests therefrom. 

Preferably, the digital imaging apparatus is a digital 

2 5 camera, or else an analogue video camera provided with 

appropriate digitiser hardware. The apparatus may comprise 
means for moving the objective lens of the microscope in 
order to provide automatic focussing. 

In a preferred embodiment, a continuous sequence of 

3 0 successive images of the specimen is obtained by advancing 

the field of view of the objective lens of the microscope 
stepwise across the specimen and acquiring an image of each 
field of view. The objective lens is selected to ensure 
sufficient resolution in the images of the specimen and 
3 5 sufficient images are captured and stored to cover the 
whole area of the specimen on the microscope stage. 
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The apparatus may comprises means for recording what 
image data is requested for review of the performance of a 
user. The recording means maybe a data storage disk, such 
as a floppy disk. 

With a knowledge of the pixel size and number in the 
imaging apparatus used and the calibrated magnification of 
the objective of the microscope, the computer moves the 
stage such that adjacent images are effectively continuous 
in the two dimensional specimen plane, and can be thought 
of as 'tiles 1 in a very large composite 'montage 1 virtual 
image . 

The above and other aspects of the present invention 
will now be described in further detail, by way of example 
only, with reference to the accompanying figures, in which: 
Figure 1 illustrates schematically an embodiment of 
the apparatus in accordance with the present invention; 

Figure 2 is complete navigational map of a sample on 
a microscope slide which has been imaged in accordance with 
an embodiment of the method of the present invention; and 
Figure 3 illustrates in further detail one aspect of 
the embodiment of Figure 1. 

Referring to the Figures, a biopsy sample for analysis 
is taken and mounted upon a microscope slide 10 in a 
conventional manner. The specimen slide 10 is placed upon 
a motor driven stage 11 of a microscope 12 fitted with a 
camera 13, typically a digital, high resolution CCD camera 
of diagnostic quality - at least 1024 x 1024 pixels, 24 bit 
colour. The stage is adjustable in three dimensions with 
respect to the focal axis of the objective. This is 
typically achieved with a computer 16 controlled motorised 
movable stage 11, but could equally well, if 
unconventionally, be achieved with a static stage and a 
movable ob j ect ive . 

The objective lens 14 is selected according to the 
maximum desired resolution for the task in hand - typically 
10X, 2 OX or 4 OX. The complete specimen is imaged by 
capturing an image of a first field (or area of the 


specimen) 20, advancing the stage to an adjacent field 21, 
capturing an image of that field, indexing to the next 
field 22 and so on (referred to as scanning) . The 
individual field images 20, 21, 22 etc are stored on disk 
as part of a single large file or may be digitally 
compressed and stored electronically representing a high 
resolution virtual image of the original slide specimen. At 
the same time, a decimated copy of the very large image is 
created to represent a low resolution navigation map 30. 
Typically, the number of pixels in the low resolution map 
30 will be the same as that in each of the original images 
20, 21, for example 1024 x 1024. The total time for 
acquisition of the collection of high resolution images 
will typically be around 5-20 minutes, depending, of 
course, upon the specimen area to be scanned and the field 
of view of the objective lens. 

When scanning with the high power objective, a problem 
is often encountered in that it is difficult to drive the 
motor ised stage, such that it is normal to the optical axis 
of the microscope. Indeed, microscope slides are not 
perfectly flat. Because of this, the need arises to 
refocus the microscope periodically when scanning a 
specimen. Refocussing adds significantly to overall scan 
time. This can be overcome with the present invention by 
means of a piezo-electric driver, or other objective lens 
moving device, rather than requiring the movement of the 
motorised stage relative to a fixed objective lens. 

This occurs before the consultant becomes involved and 
so maintains a high efficiency in terms of consultant time. 

In practice, based on a knowledge of the pixel size 
and number in the camera and the calibrated magnification 
of the objective of the microscope, the distance by which 
the stage must move between each image acquisition is 
calculated. The stage is moved to the co-ordinates of the 
selected starting point and the first image is acquired. 
The image is compressed and stored to disk and a 
low-resolution tile is made from that image. With a 
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knowledge of where the tile image originated, the tile is 
"pasted" onto a navigation map matrix and stored. The stage 
is then advanced to the next co-ordinates and the next 
image is acquired. 
5 By making use of multi-thread software design, it is 

possible to optimise scan time by arranging for image 
compression and storage to run in parallel with stage 
movement and image acquisition. 

The microscope stage 11 and the CCD camera 13 are 
10 controlled by appropriate hardware and software of the 
server 15, in a generally conventional manner. 

As is evident from the image shown in Figure 2 , 
unevenness in specimen illumination may lead to a certain 
degree of shading around the periphery of each field image. 
15 If desired, the high resolution image can be digitally 
processed to remove this shading. However, it is envisaged 
that consultants will generally prefer to see a "raw" image 
for fear of the loss of important detail if the image is 
excessively post-processed. 
20 The navigation map 30 and collection of high 

resolution images are stored locally in computer memory in 
a computer or server 15. For a typical 20 x 50 mm specimen 
as described in the introduction, such a collection of high 
resolution images could be expected, with 50-100-fold 

2 5 digital compression, to occupy up to around 1Gb of memory. 

Typically, a compressed navigation map might be expected to 
occupy around 50Kb of memory. 

At this stage, access to the microscope is no longer 
required and it can be put to use on the next slide. 

3 0 Communication may now be made between the local server 15 

and the consultant at a remote computer 16, upon which is 
mounted the appropriate client software. Communication may 
be via a dedicated link, for example to a centralised 
expert diagnostic centre, or by any other suitable means, 
35 such as over the Internet even to a consultant's portable 
computer. The system is not limited to one: one connections. 
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The server can be configured to support simultaneous access 
by multiple clients. 

At his client computer 16, the consultant receives the 
low resolution 'navigation map' 30 of the entire specimen 
5 image from which he can access the high resolution images. 
As the compressed navigation map is comparatively small, 
there is only a minimal delay whilst the data is 
transferred. In its simplest form, an original high 
resolution image itself is retrieved simply by clicking or 

10 otherwise selecting the appropriate area in the navigation 
map 30. In another embodiment, the consultant is able to 
select any specific area of interest by "rubber banding" a 
rectangular region either on the client's navigation map 
display, or else on the currently displayed field of view. 

15 The server then extracts the appropriate high resolution 
image from a very large compressed file, then compresses 
this f ield-of-interest view and sends it to the client 
computer 16. 

Typically, the consultant will have two computer 
20 monitors, the first monitor 35 to continually display the 
navigation map 30 and the second monitor 36 to allow the 
consultant to display a high resolution image 4 0 of an area 
4 1 selected by the consultant by "rubberbanding" a desired 
area from the map 3 0 using, for example, a mouse connected 
25 to his terminal. The server 15 will immediately access the 
image store and construct a compressed image corresponding 
to the selected area for transmission to the client 
computer. In the limit of magnification, the enlarged image 
40 on the second monitor 36 will typically correspond to 
3 0 the magnification used in the scanning procedure, but it 
could typically be digitally enlarged up to around twice 
the scanned magnification without loss of apparent image 
quality. 

In a further preferred embodiment the remote 
3 5 consultant will be able to reconstruct the navigation map. 
If for example, it is clear at first sight that 50% of the 
navigation map 30 shows nothing at all or is not relevant 


to the diagnosis, it may be distracting for the consultant 
to have it constantly displayed on the first screen 35. 
Accordingly, the consultant can 'rubberband' the desired 
area and the server will construct a new navigation map and 
transmit it to the client computer. Thus the new navigation 
map may be at the same resolution as the original map or at 
an increased resolution as desired. 

An advantage of the present system is that the complex 
and storage intensive data processing is carried out by the 
server 15 locally to the microscope, such that only that 
image data called upon by the consultant needs to be 
transmitted to the consultant's computer 16. That data is 
comparatively small and can thus be transmitted quickly. 
The client computer 16 is not required to carry out any 
complex data processing other than decompression and 
display of the images retrieved from the server. In 
addition, the server can be configured to allow multiple 
concurrent accessing of the data, for the purposes, for 
example, of multiple diagnosis or teaching. 

In the preferred embodiment illustrated, the second 
monitor 36 also displays small thumbnail images 45 of areas 
previously examined in detail as an enlarged image 41. 
These thumbnail images 45 are temporarily stored locally to 
facilitate rapid retrieval should the consultant so 
require. Ultimately, the original image data corresponding 
to the thumbnail images, and including the navigation map 
image 30, can be stored centrally constituting a part of 
the patient's medical records and also serving as an 
5 audit trail recording those areas of the slide which were 
actually examined by the consultant. The remaining high 
resolution images on the server can be discarded or backed 
up as desired. This illustrates a yet further advantage of 
the present invention. It is inherently well adapted for 
efficient data warehousing and provides a useful compromise 
between storing the whole data and storing no data. Neither 
of the existing dynamic or static telemicroscopy techniques 
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can provide such a feature without considerable additional 
modification . 

Use of the present invention allows the remote 
consultant access to any area of the slide at will, and 
allows him to control magnification at will. In many 
applications, it is as fast as direct examination of the 
local slide. 

Having described the use of two screens, it will be 
immediately apparent that the same result can be achieved 
using separate virtual screens or windows within a GUI 
operating system upon the same monitor screen. 

The apparatus and method of the present invention are 
particularly well suited to the majority of occasions where 
an immediate diagnosis is not required and its primary 
advantage is in the speeding up of non-urgent cases * It 
avoids the need for microscope samples to be transferred 
between hospitals, being advantageous both in terms of 
reducing the delays due to samples being in transit and the 
risks associated with transferring possibly dangerous 
samples. However, the invention is also potentially 
suitable for those cases where an immediate diagnosis is 
required, for example when a frozen section sample has been 
taken from a patient during an exploratory operation. This 
feature will be particularly advantageous in highly 
specialised areas of medicine in which there may be only a 
few suitably experienced clinicians who may well be in 
other parts of the world when a diagnosis is required. 

In summary, the present invention overcomes the stated 
limitations of static telemicroscopy without the high cost 
entailed in dynamic telemicroscopy. Cost saving is 
primarily through reduction of consultant time. This is 
essential to realise the potential benefits to quality of 
diagnosis in routine telepathology etc. Furthermore, the 
scanning process can easily be adapted to unattended hatch 
processing, in which, not just one slide but a collection 
of slides is scanned sequentially. 
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The simplicity of providing multiple access to the 
server makes the invention ideal for teaching purposes, as 
well as for professional quality assurance assessment. 

The concepts described above can be applied as a 
teaching apparatus and for professional quality assurance 
by providing the apparatus with a return path in which the 
apparatus returns information about the fields of view 
selected by the operator. The apparatus may also provide 
means for enabling annotation to be inserted by a user to 
provide total feedback of the user's approach to a 
monitoring teacher. 

With such an arrangement it is not necessary to return 
actual images, but simply to return the bounds information 
on the boundaries of the field within the frame of 
reference of the large-scale virtual image. This is 
because the teacher has access to an exact copy and 
reconstruction can be performed at the teacher 1 s server. 
In this way, an entire diagnostic session can be returned 
in a file which can be easily transmitted by E-mail or on 
a floppy disk, for example. 

Whilst, as with the above example, the image provider 
(teacher) and the image reviewer (the student) can be at 
either end of a local area network or other 
telecommunications, other possibilities are available. For 
example an appropriate data storage device, such as a CD- 
ROM could incorporate all of the image data and when loaded 
into an appropriately configured PC can emulate a remotely 
accessed system. 


